WO2021118200A1 - 3d model compression and decompression system and method based on 3d mesh segmentation - Google Patents

3d model compression and decompression system and method based on 3d mesh segmentation Download PDF

Info

Publication number
WO2021118200A1
WO2021118200A1 PCT/KR2020/017840 KR2020017840W WO2021118200A1 WO 2021118200 A1 WO2021118200 A1 WO 2021118200A1 KR 2020017840 W KR2020017840 W KR 2020017840W WO 2021118200 A1 WO2021118200 A1 WO 2021118200A1
Authority
WO
WIPO (PCT)
Prior art keywords
mesh
segmentation
decompression
compression
segmented
Prior art date
Application number
PCT/KR2020/017840
Other languages
French (fr)
Korean (ko)
Inventor
김성제
김제우
윤주홍
박민규
정진우
Original Assignee
한국전자기술연구원
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 한국전자기술연구원 filed Critical 한국전자기술연구원
Publication of WO2021118200A1 publication Critical patent/WO2021118200A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T9/00—Image coding
    • G06T9/001—Model-based coding, e.g. wire frame
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/20—Finite element generation, e.g. wire-frame surface description, tesselation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T9/00—Image coding

Definitions

  • the present invention relates to a system and method for compression and decompression of a 3D model, and more particularly, to segment a 3D mesh into an optimal number using a segmentation algorithm, and to divide the segmented mesh pieces in parallel using each encoder instance simultaneously
  • 3D mesh data representing a 3D model is widely used in various multimedia fields such as computer graphics, animation, and games.
  • 3D mesh data providing high immersion and realism has a large amount of information, and interest in compression techniques for storing or transmitting such data is increasing.
  • the 3D mesh data When a 3D image (model) needs to be transmitted in real time, the 3D mesh data must be compressed within the time between the current frame and the next frame. For example, if 30 frames per second need to be compressed and transmitted, the compression time per frame should be reduced to 33ms or less.
  • the existing 3D mesh data compression method has a disadvantage in that it takes a long time because a large amount of data needs to be compressed.
  • the present invention has been devised to solve the above problems, and an object of the present invention is to perform high-speed compression by dividing the mesh without compressing the 3D mesh including a large amount of data and performing compression simultaneously in parallel.
  • a 3D mesh segmentation-based 3D model compression and decompression method includes: inputting 3D mesh data; segmenting the input 3D mesh data; and parallelly compressing the segmented at least two or more mesh pieces using respective encoder instances.
  • the 3D mesh segmentation-based 3D model compression and decompression method may further include merging the compressed data in parallel.
  • the input 3D mesh data may be segmented using a semantic segmentation algorithm or a high-speed segmentation method through reconstruction of triangle information.
  • the high-speed segmentation method may be a method of generating a plurality of segmentation sets as evenly as possible in the order of triangle indices, and generating a segmentation mesh including vertices corresponding to all triangle information in the segmentation set.
  • the 3D mesh segmentation-based 3D model compression and decompression method may further include receiving and segmenting a bitstream, and decompressing the segmented bitstream in parallel.
  • the decompression step may be performed in the reverse direction with the encoder using the bitstream as an input to generate a 3D mesh.
  • information on the number of divided regions and the starting point of each divided region may be included in a header.
  • a 3D mesh segmentation based 3D model compression and decompression system includes: an input unit to which 3D mesh data is input; and a processor for segmenting the input 3D mesh data and compressing the segmented at least two or more mesh pieces using respective encoder instances in parallel.
  • compression can be efficiently performed by using an optimal partitioning algorithm in consideration of compression speed and efficiency in partitioning a 3D mesh.
  • FIG. 1 is a flowchart provided in the description of a 3D mesh segmentation based 3D model compression and decompression method according to an embodiment of the present invention
  • 3 is a 3D mesh segmentation based decompression flow diagram
  • FIG. 5 is a diagram illustrating a decompression result according to a conventional single mesh compression method
  • FIG. 6 is a diagram illustrating a decompression result according to a split mesh compression method according to an embodiment of the present invention.
  • FIG. 7 is a diagram provided for explanation of a 3D mesh segmentation based 3D model compression and decompression system according to an embodiment of the present invention.
  • FIG. 1 is a flowchart provided for the description of a 3D mesh segmentation based 3D model compression and decompression method according to an embodiment of the present invention
  • FIG. 2 is a 3D mesh segmentation based compression flowchart
  • FIG. 3 is a 3D mesh segmentation based decompression flowchart 4 is a diagram illustrating a 3D mesh division process
  • FIG. 5 is a diagram illustrating a decompression result according to a conventional single mesh compression method
  • FIG. 6 is a divided mesh compression method according to an embodiment of the present invention. It is a diagram exemplifying the decompression result according to .
  • the 3D mesh segmentation-based 3D model compression and decompression method does not compress a 3D mesh containing a large amount of data, but divides the mesh and performs high-speed compression by simultaneously performing compression in parallel.
  • the 3D mesh segmentation-based 3D model compression and decompression method includes an input step of inputting 3D mesh data (S110), a splitting step of dividing the input 3D mesh data (S120), and at least two or more divided mesh pieces.
  • the 3D mesh segmentation-based 3D model compression and decompression method divides the input 3D mesh using a segmentation algorithm in the segmentation step, and divides the segmented parts in parallel using two or more encoder instances in the compression step. can be compressed.
  • the input 3D mesh data may be segmented using a semantic segmentation algorithm or a high-speed segmentation method through reconstruction of triangle information.
  • the high-speed segmentation method is a method of generating a plurality of segmented sets as equally as possible in the order of triangle indices, and generating a segmented mesh including vertices corresponding to all triangle information in the segmented set.
  • the bitstream merging module may collect compressed data and merge them into one bitstream.
  • 2 shows the parallel compression and bitstream merging process of several encoders according to 3D mesh segmentation.
  • the decompression step may be performed in the reverse direction with the encoder by taking the input bitstream as an input as shown in FIG. 3 to generate a 3D mesh.
  • bitstream splitter is required instead of a bitstream merger
  • model merger is required instead of segmentation
  • the bitstream splitter creates several split bitstreams in consideration of the number of split regions and the start point of the split regions.
  • the single mesh on the left contains 8 vertices and 6 triangles.
  • the mesh on the left contains 8 vertices and 6 triangles.
  • the two divided meshes will contain 5 vertices and 3 triangles, respectively, and the sum of the vertices of the two meshes will increase from 8 to 10.
  • the 3D mesh segmentation method uses the existing segmentation method centered on semantic segmentation or the following method which prioritizes speed.
  • the mesh segmentation method that prioritizes segmentation speed is as follows.
  • the mesh division-based compression and decompression method according to the present invention slightly increases the bit rate compared to the existing method, but this is a very insignificant number and shows a speed three times faster than the conventional method.
  • 5 to 6 show decompression results according to the single mesh compression method and the split mesh compression method according to the present invention.
  • the split mesh compression method of the present invention can compress a 3D mesh including a large amount of data faster and more efficiently by shortening the compression time while maintaining performance.
  • FIG. 7 is a diagram provided for explanation of a 3D mesh segmentation based 3D model compression and decompression system according to an embodiment of the present invention.
  • the 3D mesh segmentation based 3D model compression and decompression system may include an input unit 210 , a processor 220 , and a storage unit 230 .
  • the input unit 210 may allow 3D mesh data to be input.
  • the storage unit 230 is a storage medium for storing programs and data necessary for the processor 220 to operate.
  • the processor 220 may segment the input 3D mesh data and compress at least two or more segmented mesh pieces in parallel using each encoder instance.
  • processor 220 may merge parallel compressed data, receive and split the bitstream, and decompress the divided bitstream in parallel.
  • compression can be efficiently performed by using an optimal partitioning algorithm in consideration of compression speed and efficiency in partitioning the 3D mesh.
  • the technical idea of the present invention can also be applied to a computer-readable recording medium containing a computer program for performing the functions of the apparatus and method according to the present embodiment.
  • the technical ideas according to various embodiments of the present invention may be implemented in the form of computer-readable codes recorded on a computer-readable recording medium.
  • the computer-readable recording medium may be any data storage device readable by the computer and capable of storing data.
  • the computer-readable recording medium may be a ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical disk, hard disk drive, or the like.
  • the computer-readable code or program stored in the computer-readable recording medium may be transmitted through a network connected between computers.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Software Systems (AREA)
  • Multimedia (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
  • Processing Or Creating Images (AREA)

Abstract

A 3D model compression and decompression system and method based on 3D mesh segmentation are provided. A 3D model compression and decompression method based on 3D mesh segmentation, according to one embodiment of the present invention, comprises the steps of: inputting 3D mesh data; segmenting the inputted 3D mesh data; and compressing, in parallel, at least two segmented mesh pieces by using each encoder instance. Therefore, according to embodiments of the present invention, a 3D mesh is segmented and the segmented mesh pieces are simultaneously compressed in parallel, so that 3D model data can be compressed more quickly than that by conventional technology. In addition, an optimum segmentation algorithm that considers compression speed and efficiency is used when segmenting a 3D mesh, and thus compression is efficiently performed.

Description

3D 메시 분할 기반 3D 모델 압축 및 압축해제 시스템 및 방법3D mesh segmentation based 3D model compression and decompression system and method
본 발명은 3D 모델의 압축 및 압축해제 시스템 및 방법에 관한 것으로, 더욱 상세하게는 3D 메시를 분할 알고리즘을 이용하여 최적의 수로 분할하고 분할된 메시 조각들을 각각의 인코더 인스턴스를 이용하여 동시에 병렬적으로 압축을 수행하며 압축된 결과를 하나의 비트스트림으로 병합하여 제공하며, 하나의 비트스트림으로 압축된 데이터를 압축해제하는 3D 메시 분할 기반 3D 모델 압축 및 압축해제 시스템 및 방법에 관한 것이다.The present invention relates to a system and method for compression and decompression of a 3D model, and more particularly, to segment a 3D mesh into an optimal number using a segmentation algorithm, and to divide the segmented mesh pieces in parallel using each encoder instance simultaneously A system and method for 3D mesh segmentation-based 3D model compression and decompression that perform compression, merge compressed results into one bitstream, and decompress data compressed into one bitstream.
3D 모델을 표현하는 3D 메시 데이터는 컴퓨터 그래픽, 애니메이션 및 게임과 같은 다양한 멀티미디어 분야에서 널리 사용되고 있다. 높은 몰입감과 사실감을 제공하는 3D 메시 데이터는 많은 양의 정보를 가지며, 이러한 데이터를 저장 또는 전송하기 위한 압축 기술에 대한 관심이 높아지고 있다.3D mesh data representing a 3D model is widely used in various multimedia fields such as computer graphics, animation, and games. 3D mesh data providing high immersion and realism has a large amount of information, and interest in compression techniques for storing or transmitting such data is increasing.
3D 영상(모델)이 실시간으로 전송되어야 하는 경우에는 3D 메시 데이터가 현재 프레임과 다음 프레임 사이의 시간 안에 압축이 완료되어야 한다. 예를 들어 초당 30 프레임을 압축하여 전송해야 하는 경우에 프레임 당 압축시간을 33ms 이하로 감소시켜야 한다. 그러나 기존의 3D 메시 데이터 압축 방법은 방대한 양의 데이터를 압축해야하기 때문에 시간이 오래 걸린다는 단점이 있다.When a 3D image (model) needs to be transmitted in real time, the 3D mesh data must be compressed within the time between the current frame and the next frame. For example, if 30 frames per second need to be compressed and transmitted, the compression time per frame should be reduced to 33ms or less. However, the existing 3D mesh data compression method has a disadvantage in that it takes a long time because a large amount of data needs to be compressed.
이를 해결하기 위하여 기존 3D 메시 데이터 압축 기술보다 더 빠르게 압축을 수행할 수 있는 기술이 필요하며, 압축해제 후 복원된 3D 모델의 해상도가 나빠지지 않아야 하며 복원된 영상에 시각적 인공물(visual artifacts)이 발생하지 않도록 하는 기술에 대한 연구가 필요하다.In order to solve this problem, a technology that can perform compression faster than the existing 3D mesh data compression technology is required. After decompression, the resolution of the reconstructed 3D model should not deteriorate, and visual artifacts are generated in the reconstructed image. Research on techniques to prevent this from happening is needed.
본 발명은 상기와 같은 문제점을 해결하기 위하여 안출된 것으로서, 본 발명의 목적은, 많은 양의 데이터를 포함하는 3D 메시를 통으로 압축하지 않고 메시를 분할하여 각각 동시에 병렬적으로 압축을 수행함으로써 고속 압축을 수행할 수 있는 3D 메시 분할 기반 3D 모델 압축 및 압축해제 시스템 및 방법을 제공함에 있다.The present invention has been devised to solve the above problems, and an object of the present invention is to perform high-speed compression by dividing the mesh without compressing the 3D mesh including a large amount of data and performing compression simultaneously in parallel. To provide a 3D mesh segmentation based 3D model compression and decompression system and method that can perform
상기 목적을 달성하기 위한 본 발명의 일 실시예에 따른, 3D 메시 분할 기반 3D 모델 압축 및 압축해제 방법은, 3D 메시 데이터를 입력하는 단계; 입력된 3D 메시 데이터를 분할하는 단계; 및 분할된 적어도 둘 이상의 메시 조각을 각각의 인코더 인스턴스를 이용하여 병렬적으로 압축하는 단계;를 포함한다.According to an embodiment of the present invention for achieving the above object, a 3D mesh segmentation-based 3D model compression and decompression method includes: inputting 3D mesh data; segmenting the input 3D mesh data; and parallelly compressing the segmented at least two or more mesh pieces using respective encoder instances.
그리고 본 발명의 일 실시예에 따른, 3D 메시 분할 기반 3D 모델 압축 및 압축해제 방법은, 병렬적으로 압축된 데이터들을 병합하는 단계;를 더 포함할 수 있다. And according to an embodiment of the present invention, the 3D mesh segmentation-based 3D model compression and decompression method may further include merging the compressed data in parallel.
또한, 분할 단계는, 의미론적 분할 알고리즘이나 또는 삼각형 정보의 재구성을 통한 고속 분할 방법을 사용하여, 입력된 3D 메시 데이터를 분할할 수 있다. Also, in the segmentation step, the input 3D mesh data may be segmented using a semantic segmentation algorithm or a high-speed segmentation method through reconstruction of triangle information.
그리고 고속 분할 방법은, 삼각형의 인덱스 순서대로 최대한 균등하게 여러 개의 분할 집합을 생성하고, 분할 집합 내에 모든 삼각형 정보에 대응하는 정점을 포함하여 분할 메시를 생성하는 방법일 수 있다. In addition, the high-speed segmentation method may be a method of generating a plurality of segmentation sets as evenly as possible in the order of triangle indices, and generating a segmentation mesh including vertices corresponding to all triangle information in the segmentation set.
또한, 3D 메시 분할 기반 3D 모델 압축 및 압축해제 방법은, 비트스트림을 받아 분할하고, 분할된 비트스트림을 병렬적으로 압축해제하는 단계;를 더 포함할 수 있다. In addition, the 3D mesh segmentation-based 3D model compression and decompression method may further include receiving and segmenting a bitstream, and decompressing the segmented bitstream in parallel.
그리고 압축해제 단계는, 비트스트림을 입력으로 하여 인코더와 역방향으로 수행하여 3D 메시를 생성할 수 있다.In addition, the decompression step may be performed in the reverse direction with the encoder using the bitstream as an input to generate a 3D mesh.
또한, 비트스트림은, 생성 과정에서 헤더(header)에 분할 영역의 개수와 각 분할 영역의 시작점에 대한 정보가 포함되도록 할 수 있다. In addition, in the process of generating the bitstream, information on the number of divided regions and the starting point of each divided region may be included in a header.
한편, 본 발명의 다른 실시예에 따른, 3D 메시 분할 기반 3D 모델 압축 및 압축해제 시스템은, 3D 메시 데이터가 입력되는 입력부; 및 입력된 3D 메시 데이터를 분할하고, 분할된 적어도 둘 이상의 메시 조각을 각각의 인코더 인스턴스를 이용하여 병렬적으로 압축하는 프로세서;를 포함한다.Meanwhile, according to another embodiment of the present invention, a 3D mesh segmentation based 3D model compression and decompression system includes: an input unit to which 3D mesh data is input; and a processor for segmenting the input 3D mesh data and compressing the segmented at least two or more mesh pieces using respective encoder instances in parallel.
이상 설명한 바와 같이, 본 발명의 실시예들에 따르면, 3D 메시를 분할하고, 분할된 메시 조각들에 대해 동시에 병렬적으로 압축을 수행함으로써 기존 기술보다 더 빠르게 3D 모델 데이터의 압축을 수행할 수 있다.As described above, according to embodiments of the present invention, it is possible to perform compression of 3D model data faster than conventional techniques by dividing a 3D mesh and simultaneously performing compression on the divided mesh pieces in parallel. .
또한, 본 발명의 실시예들에 따르면, 3D 메시를 분할함에 있어서 압축 속도와 효율을 고려한 최적의 분할 알고리즘을 사용함으로써 효율적으로 압축을 수행할 수 있다.In addition, according to embodiments of the present invention, compression can be efficiently performed by using an optimal partitioning algorithm in consideration of compression speed and efficiency in partitioning a 3D mesh.
도 1은 본 발명의 일 실시예에 따른 3D 메시 분할 기반 3D 모델 압축 및 압축해제 방법의 설명에 제공된 흐름도, 1 is a flowchart provided in the description of a 3D mesh segmentation based 3D model compression and decompression method according to an embodiment of the present invention;
도 2는 3D 메시 분할 기반 압축 흐름도,2 is a 3D mesh segmentation based compression flow diagram;
도 3은 3D 메시 분할 기반 압축해제 흐름도,3 is a 3D mesh segmentation based decompression flow diagram;
도 4는 3D 메시 분할 과정이 예시된 도면, 4 is a diagram illustrating the 3D mesh segmentation process;
도 5는 종래의 단일 메시 압축 방법에 따른 압축해제 결과가 예시된 도면, 5 is a diagram illustrating a decompression result according to a conventional single mesh compression method;
도 6은 본 발명의 일 실시예에 따른 분할 메시 압축 방법에 따른 압축해제 결과가 예시된 도면, 그리고 6 is a diagram illustrating a decompression result according to a split mesh compression method according to an embodiment of the present invention, and
도 7은 본 발명의 일 실시예에 따른 3D 메시 분할 기반 3D 모델 압축 및 압축해제 시스템의 설명에 제공된 도면이다.7 is a diagram provided for explanation of a 3D mesh segmentation based 3D model compression and decompression system according to an embodiment of the present invention.
이하에서는 도면을 참조하여 본 발명을 보다 상세하게 설명한다.Hereinafter, the present invention will be described in more detail with reference to the drawings.
도 1은 본 발명의 일 실시예에 따른 3D 메시 분할 기반 3D 모델 압축 및 압축해제 방법의 설명에 제공된 흐름도이고, 도 2는 3D 메시 분할 기반 압축 흐름도이며, 도 3은 3D 메시 분할 기반 압축해제 흐름도이고, 도 4는 3D 메시 분할 과정이 예시된 도면이며, 도 5는 종래의 단일 메시 압축 방법에 따른 압축해제 결과가 예시된 도면이고, 도 6은 본 발명의 일 실시예에 따른 분할 메시 압축 방법에 따른 압축해제 결과가 예시된 도면이다. 1 is a flowchart provided for the description of a 3D mesh segmentation based 3D model compression and decompression method according to an embodiment of the present invention, FIG. 2 is a 3D mesh segmentation based compression flowchart, and FIG. 3 is a 3D mesh segmentation based decompression flowchart 4 is a diagram illustrating a 3D mesh division process, FIG. 5 is a diagram illustrating a decompression result according to a conventional single mesh compression method, and FIG. 6 is a divided mesh compression method according to an embodiment of the present invention. It is a diagram exemplifying the decompression result according to .
본 실시예에 따른 3D 메시 분할 기반 3D 모델 압축 및 압축해제 방법은, 많은 양의 데이터를 포함하는 3D 메시를 통으로 압축하지 않고 메시를 분할하여 각각 동시에 병렬적으로 압축을 수행함으로써 고속 압축을 수행할 수 있다.The 3D mesh segmentation-based 3D model compression and decompression method according to this embodiment does not compress a 3D mesh containing a large amount of data, but divides the mesh and performs high-speed compression by simultaneously performing compression in parallel. can
이를 위해, 3D 메시 분할 기반 3D 모델 압축 및 압축해제 방법은, 3D 메시 데이터를 입력하는 입력 단계(S110), 입력된 3D 메시 데이터를 분할하는 분할 단계(S120), 분할된 적어도 둘 이상의 메시 조각을 각각의 인코더 인스턴스를 이용하여 병렬적으로 압축하는 압축 단계(S130), 병렬적으로 압축된 데이터들을 병합하는 병합 단계(S140) 및 비트스트림을 받아 분할하고, 분할된 비트스트림을 병렬적으로 압축해제하는 압축해제 단계(S150)으로 구성될 수 있다. To this end, the 3D mesh segmentation-based 3D model compression and decompression method includes an input step of inputting 3D mesh data (S110), a splitting step of dividing the input 3D mesh data (S120), and at least two or more divided mesh pieces. A compression step (S130) of parallelly compressing using each encoder instance, a merging step (S140) of merging parallel compressed data, and receiving and dividing the bitstream, and decompressing the divided bitstream in parallel It may be composed of a decompression step (S150).
즉, 3D 메시 분할 기반 3D 모델 압축 및 압축해제 방법은, 분할 단계에서, 입력된 3D 메시를 분할 알고리즘을 이용하여 분할하고, 압축 단계에서, 분할된 부분들을 둘 이상의 인코더 인스턴스를 이용하여 병렬적으로 압축할 수 있다. That is, the 3D mesh segmentation-based 3D model compression and decompression method divides the input 3D mesh using a segmentation algorithm in the segmentation step, and divides the segmented parts in parallel using two or more encoder instances in the compression step. can be compressed.
예를 들면, 분할 단계에서는, 의미론적 분할 알고리즘이나 또는 삼각형 정보의 재구성을 통한 고속 분할 방법을 사용하여, 입력된 3D 메시 데이터를 분할할 수 있다. For example, in the segmentation step, the input 3D mesh data may be segmented using a semantic segmentation algorithm or a high-speed segmentation method through reconstruction of triangle information.
이때, 고속 분할 방법은, 삼각형의 인덱스 순서대로 최대한 균등하게 여러 개의 분할 집합을 생성하고, 분할 집합 내에 모든 삼각형 정보에 대응하는 정점을 포함하여 분할 메시를 생성하는 방법이다. In this case, the high-speed segmentation method is a method of generating a plurality of segmented sets as equally as possible in the order of triangle indices, and generating a segmented mesh including vertices corresponding to all triangle information in the segmented set.
모든 인코더의 압축이 완료되면 비트스트림 병합모듈은 압축된 데이터를 모아 하나의 비트스트림으로 병합할 수 있다. 도 2는 3D 메시 분할에 따른 여러 인코더의 병렬 압축 및 비트스트림 병합 과정을 보여준다. When compression of all encoders is completed, the bitstream merging module may collect compressed data and merge them into one bitstream. 2 shows the parallel compression and bitstream merging process of several encoders according to 3D mesh segmentation.
압축해제 단계는 도 3과 같이 입력 비트스트림을 입력으로 하여 인코더와 역방향으로 수행하여 3D 메시를 생성할 수 있다. The decompression step may be performed in the reverse direction with the encoder by taking the input bitstream as an input as shown in FIG. 3 to generate a 3D mesh.
이때, 인코딩 과정과의 차이점은 bitstream merger 대신에 bitstream splitter가 필요하고, segmentation 대신 model merger가 필요하다는 것이다. At this time, the difference from the encoding process is that a bitstream splitter is required instead of a bitstream merger, and a model merger is required instead of segmentation.
디코더 입장에서는 비트스트림 내에서 분할 내용을 정확하게 알 수 없으므로, 비트스트림 생성 과정에서 비트스트림 헤더 (header)에 분할 영역의 개수와 각 분할 영역의 시작점(byte 단위의 크기로 표시)에 대한 정보를 반드시 포함해야 한다. Since the decoder cannot know the details of the division within the bitstream accurately, information on the number of divisions and the starting point of each division (expressed in byte size) must be provided in the bitstream header during the bitstream generation process. should include
bitstream splitter는 분할 영역의 개수와 분할 영역의 시작점을 고려해서 여러 개의 분할 bitstream을 생성하게 된다. The bitstream splitter creates several split bitstreams in consideration of the number of split regions and the start point of the split regions.
도 4는 3D 메시를 분할하는 예시이며, 왼쪽의 단일 메시는 8개의 정점(vertex)과 6개의 삼각형을 포함한다. 왼쪽의 메시를 빨간 점선에 따라 분할하여 오른쪽 그림과 같이 두 개의 메시로 나뉠 수 있다. 분할된 두 메시는 각각 5개의 정점과 3개의 삼각형을 포함하게 되며, 두 메시의 정점의 합은 기존 8개에서 10개로 늘어나게 된다. 4 is an example of splitting a 3D mesh, and the single mesh on the left contains 8 vertices and 6 triangles. By dividing the mesh on the left along the red dotted line, it can be divided into two meshes as shown in the figure on the right. The two divided meshes will contain 5 vertices and 3 triangles, respectively, and the sum of the vertices of the two meshes will increase from 8 to 10.
이는 메시를 분할할 경우 분할된 경계 부분의 정점이 중복되므로 압축해야 하는 정점의 수가 늘어남을 의미한다. 메시를 많이 분할할수록 처리해야 할 데이터가 늘어나게 되므로 메시를 분할할 때에는 압축 속도와 코딩 효율간의 균형을 고려하여 가장 효율적인 개수로 분할하는 것이 중요하다. This means that when the mesh is split, the number of vertices that need to be compressed increases because the vertices of the divided boundary are duplicated. The more the mesh is divided, the more data to be processed. Therefore, when dividing the mesh, it is important to divide the mesh into the most efficient number in consideration of the balance between compression speed and coding efficiency.
따라서 본 발명에서는 3D 메시를 분할하는 방법은 의미론적 분할을 중심으로 하는 기존 분할 방법 을 사용하거나 속도를 최우선으로 하는 다음과 같은 방법을 사용한다.Therefore, in the present invention, the 3D mesh segmentation method uses the existing segmentation method centered on semantic segmentation or the following method which prioritizes speed.
분할 속도를 최우선하는 메시 분할 방법은 다음과 같다. The mesh segmentation method that prioritizes segmentation speed is as follows.
- 입력 메시의 삼각형 (faces) 개수를 총 인코더 인스턴스 개수로 나눠, 분할 영역 당 가능한 균등한 삼각형 개수를 같도록 분할한다.- Divide the number of faces in the input mesh by the total number of encoder instances, so that the number of possible equal triangles per segmentation is equal.
- 입력 메시의 모든 삼각형들을 균등하게 분할한 이후에는, 분할 영역 내에 모든 삼각형에 대응되는 정점 정보를 포함하도록 구성한다.- After evenly dividing all the triangles of the input mesh, configure to include vertex information corresponding to all triangles in the divided area.
본 발명에 따라 3D 메시를 분할하여 병렬적으로 압축한 결과 단일 메시를 압축하였을 때 보다 약 3배(3.28배) 정도 압축 속도가 빨라짐을 확인하였으며, 비트레이트는 비교적 높아졌으나 그 비율은 1% 이하(0.85%)이다. As a result of dividing the 3D mesh according to the present invention and compressing it in parallel, it was confirmed that the compression speed was about 3 times (3.28 times) faster than when a single mesh was compressed, and the bit rate was relatively high, but the ratio was less than 1%. (0.85%).
이에 따라 본 발명에 따른 메시 분할 기반 압축 및 압축해제 방법은 기존 방법 보다 비트레이트가 다소 증가하였으나 이는 매우 미미한 수이며 기존보다 3배 이상 빠른 속도를 보여줌을 알 수 있다. Accordingly, it can be seen that the mesh division-based compression and decompression method according to the present invention slightly increases the bit rate compared to the existing method, but this is a very insignificant number and shows a speed three times faster than the conventional method.
도 5 내지 도 6은 단일 메시 압축 방법과 본 발명에 따른 분할 메시 압축 방법에 따른 압축해제 결과를 나타내고 있다. 5 to 6 show decompression results according to the single mesh compression method and the split mesh compression method according to the present invention.
도 6을 보면 메시를 분할함에 따라 발생하는 경계선과 같은 시각적 인공물(visual artifacts)이 잘 감지되지 않음을 알 수 있다. Referring to FIG. 6 , it can be seen that visual artifacts such as boundaries generated by dividing the mesh are not well detected.
따라서 본 발명인 분할 메시 압축 방법은 성능은 유지하면서 압축 시간을 단축함으로써 많은 양의 데이터를 포함하는 3D 메시를 더 빠르고 효율적으로 압축할 수 있다.Therefore, the split mesh compression method of the present invention can compress a 3D mesh including a large amount of data faster and more efficiently by shortening the compression time while maintaining performance.
도 7은 본 발명의 일 실시예에 따른 3D 메시 분할 기반 3D 모델 압축 및 압축해제 시스템의 설명에 제공된 도면이다. 7 is a diagram provided for explanation of a 3D mesh segmentation based 3D model compression and decompression system according to an embodiment of the present invention.
도 7을 참조하면, 본 실시예에 따른 3D 메시 분할 기반 3D 모델 압축 및 압축해제 시스템은, 입력부(210), 프로세서(220) 및 저장부(230)를 포함할 수 있다. Referring to FIG. 7 , the 3D mesh segmentation based 3D model compression and decompression system according to the present embodiment may include an input unit 210 , a processor 220 , and a storage unit 230 .
입력부(210)는, 3D 메시 데이터가 입력되도록 할 수 있다. 저장부(230)는, 프로세서(220)가 동작함에 있어 필요한 프로그램 및 데이터를 저장하는 저장 매체이다. The input unit 210 may allow 3D mesh data to be input. The storage unit 230 is a storage medium for storing programs and data necessary for the processor 220 to operate.
프로세서(220)는 입력된 3D 메시 데이터를 분할하고, 분할된 적어도 둘 이상의 메시 조각을 각각의 인코더 인스턴스를 이용하여 병렬적으로 압축할 수 있다.The processor 220 may segment the input 3D mesh data and compress at least two or more segmented mesh pieces in parallel using each encoder instance.
또한, 프로세서(220)는 병렬적으로 압축된 데이터들을 병합하고, 비트스트림을 받아 분할하고, 분할된 비트스트림을 병렬적으로 압축해제할 수 있다. In addition, the processor 220 may merge parallel compressed data, receive and split the bitstream, and decompress the divided bitstream in parallel.
이를 통해, 3D 메시를 분할하고, 분할된 메시 조각들에 대해 동시에 병렬적으로 압축을 수행함으로써 기존 기술보다 더 빠르게 3D 모델 데이터의 압축을 수행할 수 있다.Through this, it is possible to perform compression of 3D model data faster than existing techniques by dividing the 3D mesh and simultaneously performing compression on the divided mesh pieces in parallel.
또한, 3D 메시를 분할함에 있어서 압축 속도와 효율을 고려한 최적의 분할 알고리즘을 사용함으로써 효율적으로 압축을 수행할 수 있다.In addition, compression can be efficiently performed by using an optimal partitioning algorithm in consideration of compression speed and efficiency in partitioning the 3D mesh.
한편, 본 실시예에 따른 장치와 방법의 기능을 수행하게 하는 컴퓨터 프로그램을 수록한 컴퓨터로 읽을 수 있는 기록매체에도 본 발명의 기술적 사상이 적용될 수 있음은 물론이다. 또한, 본 발명의 다양한 실시예에 따른 기술적 사상은 컴퓨터로 읽을 수 있는 기록매체에 기록된 컴퓨터로 읽을 수 있는 코드 형태로 구현될 수도 있다. 컴퓨터로 읽을 수 있는 기록매체는 컴퓨터에 의해 읽을 수 있고 데이터를 저장할 수 있는 어떤 데이터 저장 장치이더라도 가능하다. 예를 들어, 컴퓨터로 읽을 수 있는 기록매체는 ROM, RAM, CD-ROM, 자기 테이프, 플로피 디스크, 광디스크, 하드 디스크 드라이브, 등이 될 수 있음은 물론이다. 또한, 컴퓨터로 읽을 수 있는 기록매체에 저장된 컴퓨터로 읽을 수 있는 코드 또는 프로그램은 컴퓨터간에 연결된 네트워크를 통해 전송될 수도 있다.On the other hand, it goes without saying that the technical idea of the present invention can also be applied to a computer-readable recording medium containing a computer program for performing the functions of the apparatus and method according to the present embodiment. In addition, the technical ideas according to various embodiments of the present invention may be implemented in the form of computer-readable codes recorded on a computer-readable recording medium. The computer-readable recording medium may be any data storage device readable by the computer and capable of storing data. For example, the computer-readable recording medium may be a ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical disk, hard disk drive, or the like. In addition, the computer-readable code or program stored in the computer-readable recording medium may be transmitted through a network connected between computers.
또한, 이상에서는 본 발명의 바람직한 실시예에 대하여 도시하고 설명하였지만, 본 발명은 상술한 특정의 실시예에 한정되지 아니하며, 청구범위에서 청구하는 본 발명의 요지를 벗어남이 없이 당해 발명이 속하는 기술분야에서 통상의 지식을 가진자에 의해 다양한 변형실시가 가능한 것은 물론이고, 이러한 변형실시들은 본 발명의 기술적 사상이나 전망으로부터 개별적으로 이해되어져서는 안될 것이다.In addition, although preferred embodiments of the present invention have been illustrated and described above, the present invention is not limited to the specific embodiments described above, and the technical field to which the present invention belongs without departing from the gist of the present invention as claimed in the claims Various modifications are possible by those of ordinary skill in the art, and these modifications should not be individually understood from the technical spirit or prospect of the present invention.

Claims (8)

  1. 3D 메시 데이터를 입력하는 단계;inputting 3D mesh data;
    입력된 3D 메시 데이터를 분할하는 단계; 및 segmenting the input 3D mesh data; and
    분할된 적어도 둘 이상의 메시 조각을 각각의 인코더 인스턴스를 이용하여 병렬적으로 압축하는 단계;를 포함하는 3D 메시 분할 기반 3D 모델 압축 및 압축해제 방법.3D mesh segmentation-based 3D model compression and decompression method comprising: parallelly compressing the segmented at least two or more mesh pieces using respective encoder instances.
  2. 청구항 1에 있어서,The method according to claim 1,
    병렬적으로 압축된 데이터들을 병합하는 단계;를 더 포함하는 것을 특징으로 하는 3D 메시 분할 기반 3D 모델 압축 및 압축해제 방법.3D mesh segmentation-based 3D model compression and decompression method, characterized in that it further comprises; merging the compressed data in parallel.
  3. 청구항 1에 있어서,The method according to claim 1,
    분할 단계는,The division step is
    의미론적 분할 알고리즘이나 또는 삼각형 정보의 재구성을 통한 고속 분할 방법을 사용하여, 입력된 3D 메시 데이터를 분할하는 것을 특징으로 하는 3D 메시 분할 기반 3D 모델 압축 및 압축해제 방법.3D mesh segmentation-based 3D model compression and decompression method, characterized in that input 3D mesh data is segmented using a semantic segmentation algorithm or a high-speed segmentation method through reconstruction of triangle information.
  4. 청구항 3에 있어서,4. The method according to claim 3,
    고속 분할 방법은, The high-speed division method is
    삼각형의 인덱스 순서대로 최대한 균등하게 여러 개의 분할 집합을 생성하고, 분할 집합 내에 모든 삼각형 정보에 대응하는 정점을 포함하여 분할 메시를 생성하는 방법인 것을 특징으로 하는 3D 메시 분할 기반 3D 모델 압축 및 압축해제 방법.3D mesh division-based 3D model compression and decompression, characterized in that it is a method of generating multiple division sets as evenly as possible in the order of triangle index, and generating a division mesh including vertices corresponding to all triangle information in the division set. Way.
  5. 청구항 1에 있어서,The method according to claim 1,
    비트스트림을 받아 분할하고, 분할된 비트스트림을 병렬적으로 압축해제하는 단계;를 더 포함하는 것을 특징으로 하는 3D 메시 분할 기반 3D 모델 압축 및 압축해제 방법.3D mesh segmentation-based 3D model compression and decompression method, further comprising; receiving and segmenting the bitstream, and decompressing the segmented bitstream in parallel.
  6. 청구항 5에 있어서,6. The method of claim 5,
    압축해제 단계는, The decompression step is
    비트스트림을 입력으로 하여 인코더와 역방향으로 수행하여 3D 메시를 생성하는 것을 특징으로 하는 3D 메시 분할 기반 3D 모델 압축 및 압축해제 방법.3D mesh segmentation-based 3D model compression and decompression method, characterized in that it takes a bitstream as an input and performs it in the reverse direction with an encoder to generate a 3D mesh.
  7. 청구항 6에 있어서,7. The method of claim 6,
    비트스트림은, The bitstream is
    생성 과정에서 헤더(header)에 분할 영역의 개수와 각 분할 영역의 시작점에 대한 정보가 포함되도록 하는 것을 특징으로 하는 3D 메시 분할 기반 3D 모델 압축 및 압축해제 방법.3D mesh segmentation-based 3D model compression and decompression method, characterized in that the header includes information about the number of segmented areas and the starting point of each segmented area in the creation process.
  8. 3D 메시 데이터가 입력되는 입력부; 및an input unit for inputting 3D mesh data; and
    입력된 3D 메시 데이터를 분할하고, 분할된 적어도 둘 이상의 메시 조각을 각각의 인코더 인스턴스를 이용하여 병렬적으로 압축하는 프로세서;를 포함하는 3D 메시 분할 기반 3D 모델 압축 및 압축해제 시스템.A 3D mesh segmentation based 3D model compression and decompression system comprising a; a processor that segments input 3D mesh data and compresses the segmented at least two or more mesh pieces in parallel using each encoder instance.
PCT/KR2020/017840 2019-12-10 2020-12-08 3d model compression and decompression system and method based on 3d mesh segmentation WO2021118200A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2019-0163301 2019-12-10
KR1020190163301A KR102313555B1 (en) 2019-12-10 2019-12-10 System and method for 3D Model compression and decompression based on 3D Mesh

Publications (1)

Publication Number Publication Date
WO2021118200A1 true WO2021118200A1 (en) 2021-06-17

Family

ID=76328943

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2020/017840 WO2021118200A1 (en) 2019-12-10 2020-12-08 3d model compression and decompression system and method based on 3d mesh segmentation

Country Status (2)

Country Link
KR (1) KR102313555B1 (en)
WO (1) WO2021118200A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116993752A (en) * 2023-09-27 2023-11-03 中国人民解放军国防科技大学 Semantic segmentation method, medium and system for live-action three-dimensional Mesh model

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20000016872A (en) * 1998-08-29 2000-03-25 윤종용 3-D mesh coding method and apparatus for incremental rendering
KR20090110776A (en) * 2008-04-18 2009-10-22 한국전자통신연구원 Method and apparatus for low complexity 3d mesh compression
KR20110041977A (en) * 2009-10-16 2011-04-22 삼성전자주식회사 Apparatus and method for coding three dimentional mesh
KR20120085134A (en) * 2011-01-21 2012-07-31 삼성전자주식회사 Apparatus and method for encoding 3d mesh, and apparatus and method for decoding 3d mesh
KR20180058762A (en) * 2015-09-23 2018-06-01 코닌클리케 필립스 엔.브이. Creation of a triangular mesh for a three-dimensional image

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20000016872A (en) * 1998-08-29 2000-03-25 윤종용 3-D mesh coding method and apparatus for incremental rendering
KR20090110776A (en) * 2008-04-18 2009-10-22 한국전자통신연구원 Method and apparatus for low complexity 3d mesh compression
KR20110041977A (en) * 2009-10-16 2011-04-22 삼성전자주식회사 Apparatus and method for coding three dimentional mesh
KR20120085134A (en) * 2011-01-21 2012-07-31 삼성전자주식회사 Apparatus and method for encoding 3d mesh, and apparatus and method for decoding 3d mesh
KR20180058762A (en) * 2015-09-23 2018-06-01 코닌클리케 필립스 엔.브이. Creation of a triangular mesh for a three-dimensional image

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116993752A (en) * 2023-09-27 2023-11-03 中国人民解放军国防科技大学 Semantic segmentation method, medium and system for live-action three-dimensional Mesh model
CN116993752B (en) * 2023-09-27 2024-01-09 中国人民解放军国防科技大学 Semantic segmentation method, medium and system for live-action three-dimensional Mesh model

Also Published As

Publication number Publication date
KR102313555B1 (en) 2021-10-18
KR20210072950A (en) 2021-06-18

Similar Documents

Publication Publication Date Title
US5974172A (en) Method and apparatus for coding segmented regions which may be transparent in video sequences for content-based scalability
EP0873654B1 (en) Image segmentation
US20030055833A1 (en) Data structure for efficient access to variable-size data
WO2009128660A2 (en) Method and apparatus for real time 3d mesh compression, based on quanitzation
EP4099699A1 (en) Image encoding method and apparatus, and image decoding method and apparatus
CN110691250B (en) Image compression apparatus combining block matching and string matching
US12020461B2 (en) Method and apparatus for Haar-based point cloud coding
WO2010090462A2 (en) Apparatus and method for encoding and decoding multi-view image
WO2021118200A1 (en) 3d model compression and decompression system and method based on 3d mesh segmentation
CN111263164A (en) High frame frequency video parallel coding and recombination method
WO2020146222A1 (en) Method and apparatus for annealing iterative geometry smoothing
KR20200022798A (en) System and method for 3d model compression and decompression
WO2023182675A1 (en) Method and device for compressing mesh by using octree-based trisoup coding
US6831637B1 (en) Method and apparatus for compressing three dimensional surface data
CN113781376B (en) High-definition face attribute editing method based on divide-and-congress
KR20240073054A (en) Point cloud data frame compression
CN104904199A (en) Method and apparatus for efficient coding of depth lookup table
WO2013028041A2 (en) Method and apparatus for encoding image, and method and apparatus for decoding image
WO2019164034A1 (en) Reconfigurable imaging system for ultra-high resolution multi-channel image processing
CN113051415B (en) Image storage method, device, equipment and storage medium
CN109901907B (en) Method and server for transmitting virtual desktop
US20240114185A1 (en) Video coding for machines (vcm) encoder and decoder for combined lossless and lossy encoding
CN107770544A (en) Using multiclass match parameter and the data compression method and device of preceding parameter buffer
WO2020085569A1 (en) Device and method for real-time division encoding
Makarov et al. Binary shape coding using finite automata

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20898164

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20898164

Country of ref document: EP

Kind code of ref document: A1